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Objective Rumination is a negative coping strategy defined as repetitive and passive focusing on negative feelings such as depression. 
The Ruminative Response Scale (RRS) is a widely-used instrument to measure rumination, but there is continuing argument about the 
construct validity of the RRS, because of probable overlap between the measurement of depression and that of rumination. The RRS-Re- 
vised (RRS-R), which removed 12 items of the RRS, is suggested as a more valid instrument for measuring rumination. Therefore, we 
translated RRS-R into Korean and explored the reliability, validity and factor structure in patients with major depressive disorders. 

Methods Seventy- nine patients with major depressive disorder took the Korean version of RRS, RRS-R, State Trait Anxiety Inventory, 
Beck Depression Inventory and Penn State Worry Questionnaire. We performed exploratory factor analysis of RRS-R, and tested con- 
struct validity, internal reliability and test-retest reliability. 

Results The internal and test-retest reliability of RRS-R was high. Factor analysis revealed that RRS-R is composed of two factors. 
'Brooding' factor explained 56.6% and 'Reflection factor explained 12.5%. RRS-R, especially 'Brooding factor', was highly correlated with 
other clinical symptoms such as depression, anxiety and worry. 

Conclusion In this study, we find out the RRS-R is more reliable and valid than the original RRS in Korean patients with depression 
because the RRS-R is free from the debate about the overlap of item with BDI. We also revealed that 'Brooding' is highly correlated with 
depressive symptoms. RRS-R may be a useful instrument to explore the implication of 'Brooding' in depression. 
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INTRODUCTION 

Most people experience depressive mood and cope in vari- 
ous ways. The two most common coping strategies for nega- 
tive emotions are problem-focused coping and emotion-fo- 
cused coping. The depressive disorders are related to emotion- 
focused coping, especially overuse of rumination.' People has 
their own consistent coping style with depressive mood, and 
those with a ruminative coping style experience depressive 
mood longer and deeper.^ 
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Rumination can be defined as repetitive and passive focus- 
ing on the meaning and implications of negative feelings, 
and is overly self-focused coping to negative emotion.^ ' Ru- 
minative response to depressed mood involves thinking about 
how sad, apathetic, and tired one feels, wondering about the 
causes of one's depressive symptoms, and worrying about 
their implications, without doing anything constructive to re- 
lieve the symptoms or improve one's mood.* Many studies re- 
port that rumination is important in developing and main- 
taining depression in both clinical and non-cUnical subjects. 
In a study in a non-cMnical sample, the participants who tend 
towards ruminative response become more depressed after 
seven weeks regardless of initial level of depression and stress 
response.^ Another study found that the ruminative response 
tendency predicts the severity of depression after one year 
among both clinical and non-cUnical subjects.'' 

Rumination has a high positive association with anxiety 
symptoms as much as depressive symptoms, and this associ- 
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ation is independent of the severity of depression.'' The rumi- 
native tendency is associated with symptoms of generalized 
anxiety disorder, posttraumatic stress disorder and social anxi- 
ety disorder/ ' Trauma-related rumination has the effect of 
maintaining intrusive memory and negative affect after trau- 
ma experience.* Rumination is also related to somatic and 
physical symptoms. Eccleston et al.'" reported that the patients 
with chronic pain had more difficulty suppressing thoughts 
about the physical symptoms than other thoughts. Children 
with more rumination of negative experience tend to suffer 
from physical symptoms." Rumination was reported to me- 
diate the relation between neuroticism - the most famous tem- 
peramental susceptibility of psychopathology - and manifest- 
ing symptoms such as anxiety and depression.'^ Therefore, 
rumination is known to be important in developing and main- 
taining the psychopathology including depression and anxiety. 

Among the instruments to measure those ruminative re- 
sponse styles, the Ruminative Response Scale (RRS) devel- 
oped by Nolen-Hoesekma has been widely used.^ The RRS was 
originally developed as a subordinate scale of the Response 
Style Questionnaire (RSQ)."^ The RSQ consists of 71 questions, 
dealing with four sorts of method of treatment such as rumi- 
native, distractive, problem-solving, and dangerous activities. 
However, the 'problem-solving' subordinate scale and 'dan- 
gerous activities' subordinate scale were omitted because later 
study found reUability to be unsatisfactory, so the present re- 
sponse style questionnaire consists of the RRS and Distract- 
ing Response Scale (DRS)." The RRS consists of 22 questions 
that focus on subjective feelings related to the depressed mood, 
symptoms, and cause and consequences of the mood, and 
has maintained almost the same content until now, although 
there were partial changes over the past few years." 

The psychometric properties of the RRS, namely, reliability 
and validity were supported through several studies. Espe- 
cially in reliability, the high inner consistency reached from 
Cronbach a 0.88 to 0.92 in the several previous studies.' '^ 
Also, several longitudinal studies showed that there is high 
test-retest reliability of Cronbach a 0.75 to 0.80, proving that 
the RRS measures an individuals tendency of ruminative re- 
sponse stably.'''*' 

There is, however, ongoing dispute about the factor struc- 
ture of the RRS in relation to construct validity, despite many 
ongoing studies. If we look at the previous studies, three fac- 
tors - symptom-based rumination, introspection/self-isola- 
tion, and self-blame - were abstracted in a study whose subject 
was a group of university students." However, another study 
whose subject was a group of patients suffering from depres- 
sion showed that two factors, symptom-focused rumination 
and self-focused rumination, were abstracted.'* 

There was an increasing need to revise the RRS because of 



repeated results that the high association between depression 
and rumination resulted from the overlap of the items between 
RRS and BDI, the measure of depression. ''''^° So Treynor et al.^' 
removed 12 questions of the RRS that apparently overlapped 
with the BDI and analyzed the factor structure of data from 
non-clinical subjects. They showed two factors: R (reflection); 
factor that shows normal self-reflective tendency and prob- 
lem-solving orientation, and B (Brooding or moody ponder- 
ing); factors that shows difficulties in the process of solving 
problems and negative self-reflection with maladjustment, 
such as 'Why me?' 

Both the 'Refection factor and 'Brooding' factor are posi- 
tively associated with depression in the cross-sectional view. 
But in longitudinal observation, the 'Reflection factor was re- 
lated with decreasing depression, and the 'Brooding' factor 
with increase of depression.^''^^ Another study also reported 
that 'Brooding' subtype had more association with anxiety and 
depression among the subtypes of rumination, so 'Brooding' 
is a poor coping strategy.^' 

In this study, we revised the original RRS by the method of 
Treynor et al.^' in the Korean version, and evaluated the reli- 
ability and validity, especially construct validity. We translat- 
ed the original RRS and removed 12 items that are similar to 
items in the BDI, administered the revised questionnaire to 
patients with depression, performed explorative factor analy- 
sis, and evaluate the association among anxiety, depression 
and worry for construct validity. 

We intend to find whether the association of depression 
with rumination comes from a real relationship or from mea- 
surement overlap. We also want to assess the association of 
'Reflection and 'Brooding' factors with clinical symptoms. In 
addition, we are going to test the gender difference of rumi- 
native tendency. 

METHODS 
Participants 

The participants were recruited among outpatients in their 
first visit with a diagnosis of major depressive disorders in 
the Department of Psychiatry, Seoul Paik Hospital, Inje Uni- 
versity from September 2010 to February 2011. Patients with 
a diagnosis and past history of psychotic disorders, bipolar 
disorders, substance use disorders and organic brain disease 
were excluded. Seventy nine participants aged from 13 to 63 
filled out the questionnaire. Among them, 33 were male and 
46 were female. The mean age was 38.70 in men, 35.32 in 
women. This study protocol was reviewed and approved by 
the Seoul Paik Hospital Institutional Review Board, and that 
written informed consent for this research project was ob- 
tained from each participant. 
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Measure instrument 

Rumination Response Scale 

This is a questionnaire in form of a self-report that evalu- 
ates the ruminative response styles, and includes 22 ques- 
tions. For this study, a licensed clinical psychologist translated 
into Korean the ruminative response scale developed by No- 
len-Hoeksema,^ and confirmed the content of the question- 
naire through debate among three researchers who have at 
least a masters degree. After that, a bilingual person re-trans- 
lated it to English and researchers reviewed and revised into 
the final version. The coefficient of the internal consistency 
(Cronbach a) of RRS was 0.92. 

Rumination Response Scale-Revised 

This study used the scale of Treynor et al.,^' which excludes 
12 questions overlapping between the RRS and BDI. Treynor 
et al.'s study showed that RRS-R consists of two factors, R (re- 
flection) and B (brooding) subordinate scale as the result of 
the factor analysis. The coefiicient of the internal consistency 
of the R-scale and B-scale (Cronbach a) were 0.72 and 0.77. 
The test-retest reliability measured during 2 years were 0.60 
and 0.62. 

Penn State Worry Questionnaire 

This is a questionnaire in form of self-report developed by 
Meyer et al.,^^ and consists of 16 questions which measure 
the symptom of worry. The Korean version was standardized 
by Kim and Min.^^ The coefficient of the internal consistency 
(Cronbach a) of the Korean version was 0.89. 

Procedure 

We first removed 12 questions (no.l, 2, 3, 4, 6, 8, 9, 14, 17, 
Table 1 . Factor structure obtained from a factor analysis of the RRS 



18, 19, 22) that overlapped with the BDI in terms of content 
as the previous study,^' and performed exploratory factor 
analysis using the principal component analysis and obUmi- 
nal rotation. We then performed the internal reliability and 
test-retest reliability test. 

For construct validity, we calculated Pearsons correlation 
test among the total points, subordinate scale points, and 
scale points of depression, anxiety, worry and physical symp- 
toms. The correlation between the original RRS and those re- 
lated scales above was also estimated and compared with the 
result of RRS-R. Finally, we closely examined the difference in 
the total points and subordinate points of the RRS and RRS-R 
according to gender. 

SPSS 12.0 for Windows (SPSS V12.0K, SPSS Inc., Chicago, 
IL, USA) was used in analyzing the technical statistics, corre- 
lation and exploratory factors of the data. 

RESULTS 

Exploratory factor analysis 

On the ground of the result from the previous study,^' we 
abstracted factors by principal component analysis and ob- 
Hminal rotation from the revised ruminative response scale 
(RSS-R) which removed 12 questions among 22 questions of 
the RRS. We found that a two factors structure model is suit- 
able for the factor coefficient matrix, and the total variance 
that those two factors explain was 69.12%. 'Brooding' factor 
explain 56.6% and 'Reflection factor, 12.5% of variance (Ta- 
ble 1). So we found the Korean version RSS-R has good con- 
struct validity. 

In examining specific factors, our result was consistent with 
the result from the factor analysis by Treynor et al.^' overall. 
However, there were different findings in details. The item 

■R (N=79) 



Item 



Factor 



Item 



15 


Think "why do I have problems other people don't have?" 


0.932 




10 


Think "why do I always react this way?" 


0.931 




13 


Think about a recent situation, wishing it had gone better 


0.799 




5 


Think "what am I doing to deserve this?" 


0.656 




20 


Analyze your personality to try to understand why you are depressed 


0.570 




12 


Write down what you are thinking and analyze it 




0.914 


21 


Go someplace alone to tiiink about your feelings 




0.646 


11 


Go away by yourself and think about why you feel this way 




0.527 


Eigenvalues 




4.528 


1.002 


% of variance 




56.6 


12.522 


Cumulative % 




56.6 


69.122 


Cronbach a 




0.728 


0.64 



Principle components analysis, obUminal rotation. RRS-R: ruminative response scale-revised. Factor 1: brooding. Factor 2: reflection 
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no.l6 was included in 'Brooding' factor and no. 7 was in 'Re- 
flection factor in the previous study, but both items were ex- 
cluded from each subordinate factor in our analysis because 
the factor loading for both items is not different. Item No.20 
(Analyze your personality to try to understand why you are 
depressed) was in the 'Reflection factor in the previous study, 
but it was in the 'Brooding' factor in our study (Table 1). 

Reliability of the RRS-R 

The internal consistency of the overall scale of the RRS-R 
(Cronbach a) was 0.89 (n=79), and the internal consistency 
of the 'Brooding' and 'Reflection subordinate scale were 0.73 
and 0.64 (n=79) respectively. 

For the test-retest reliability, 22 participants out of 79 par- 
ticipants took the scale after one month. The test-retest reli- 
ability coefficient of the RRS-R was 0.48 (n=22, p<0.05). The 
test-retest reliability coefficient of the 'Reflection subordinate 
scale was 0.54 (n=22, p<0.05) similar to the result of the pre- 
vious study.^^ However, the coefficient of 'Brooding' subordi- 
nate scale was 0.41, a little less test-retest reliability. 

Meanwhile, the test-retest reliability of the original RRS was 
low, unlike the RRS-R (r=0.33, n=22, ns). These results may 
suggest that the RRS-R is more stable than the original RRS in 
measuring the cognitive styles that respond to depression. 

Construct validity (correlation with clinical 
symptoms) 

In order to examine the construct validity of the RRS-R, we 
examined the correlation among the total scores and two sub- 
ordinate scale scores of the RRS-R, the total scores of RRS, 
BDI, STAI-S, STAI-T and PSWQ (Table 2). First, the total 
scores and two subordinate scale scores of the RRS-R showed 
high correlation with the total scores of the RRS, proving that 
the RRS-R can be used instead of the RRS. 

The total scores of the RRS-R and RRS showed significant 



positive correlation with BDI (r=0.62, p<0.001; r=0.60, p< 
0.001). This suggests that the correlation between rumination 
and depression is real and is not caused by the overlap of items 
between two measurements, because RRS-R is made by ex- 
cluding the potential overlapping items. In detail, the 'Brood- 
ing' factor had a higher association with depression than the 
'Reflection factor (r=0.62, p<0.001; r=0.41, p<0.001). 

With STAI-S, the RRS-R and RRS were significantly corre- 
lated (r=0.60, p<0.05 and r=0.65, p<0.01). The 'Brooding' fac- 
tor also had a stronger association with state anxiety than the 
'Reflection factor (r=0.65, p<0.01 and r=0.43, p<0.01). With 
STAI-T, they showed the similar patterns (r=0.73, p<0.01; r= 
0.71, p<0.01), and the 'Brooding' factor also had the stronger 
association (r=0.78, p<0.01 and r=0.52, p<0.01). 

With PSWQ, the RRS-R and RRS were positively correlated 
(r=0.69, p<0.01; r=0.58 p<0.01), and the 'Brooding' factor was 
more highly correlated with PSWQ scores than the 'Reflec- 
tion factor (r=0.67, p<0.01; r=0.57, p<0.01). 

Regarding physical symptoms, the RRS-R and RRS showed 
moderate correlation with SCL-90 (r=0.40, p<0.01; r=0.45, 
p<0.01), and the 'Brooding' factor was more related to physi- 
cal symptoms than the 'Reflection factor (r=0.46, p<0.01; r= 
0.24, p<0.01)(Table 2). 

Difference by gender 

There were no significant differences between genders in 
the total scores of RRS-R, RRS and subordinate scales of RRS- 
R, as shown on Table 3. 

DISCUSSION 

In this study, we translated the RRS developed by Nolen- 
Hoeksema^ into Korean language and produced the Korean 
version of RRS-R by excluding the items that overlap with BDI, 
following Treynor et al.^' We evaluated the reliability and va- 



Table 2. Pearson correlations among RRS-R subfactors, RRS, and measures of other clinical variables (N=79) 




RRS-R 


B 


R 


RRS 


BDI 


SCL-90 


STAI-S 


STAI-T 


PSWQ 


RRS-R 




0.923** 


0.893** 


0.777** 


0.590** 


0.397** 


0.603** 


0.727** 


0.685** 


B 


0.923** 




0.651** 


0.750** 


0.648** 


0.464** 


0.648** 


0.781** 


0.668** 


R 


0.893** 


0.651** 




0.655** 


0.405** 


0.240* 


0.430** 


0.520** 


0.567** 


RRS 


0.777** 


0.750** 


0.655** 




0.596** 


0.449** 


0.646** 


0.712** 


0.580** 


BDI 


0.590** 


0.648** 


0.405** 


0.596** 




0.705** 


0.789** 


0.805** 


0.591** 


SCL-90 


0.397** 


0.464** 


0.240* 


0.449** 


0.705** 




0.633** 


0.539** 


0.445** 


STAI-S 


0.603** 


0.648** 


0.430** 


0.646** 


0.789** 


0.633** 




0.800** 


0.665** 


STAI-T 


0.727** 


0.781** 


0.520** 


0.712** 


0.732** 


0.539** 


0.806** 




0.633** 


PSWQ 


0.685** 


0.668** 


0.567** 


0.580** 


0.591** 


0.445** 


0.665** 


0.712** 




(N=70) 





















*p<0.05, **p<0.01. RRS-R Ruminative Response Scale-Revised, B: RRS-R factor I Brooding, R: RRS-R factor II Reflection, RRS: Ruminative 
Response Scale, BDI: Beck Depression Inventory, STAI: State-Trait Anxiety Inventory, PSWQ: Penn State Worry Questionnaire 
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Table 3. Mean difference between male and female subjects on 
RRS and RRS-R subfactors 



KKo ana 

JViVO -TV SUUitlCLUlS 


Male subjects 


Female subjects 




(N=33) 


(N=46) 


t 


Mean (SD) 




RRS total scores 


46.46 (19.40) 


47.48 (17.46) 


-0.245 


RRS-R total scores 


16.39 (5.43) 


17.11 (6.03) 


-0.066 


RRS-R factor I: 


11.19 (3.99) 


11.4 (4.30) 


-0.022 


brooding 








RRS-R factor II: 


5.22 (1.94) 


5.72 (2.25) 


-0.104 


reflection 









There were no significant differences between genders in all pa- 
rameter RRS-R: Ruminative Response Scale-Revised, RRS: Rumi- 
native Response Scale 



lidity of this RRS-R among Korean patients with depression. 

Factor analysis by principal component analysis and ob- 
Uminal rotation revealed that RRS-R is composed of two fac- 
tors. 'Brooding' factor explained 56.6% and 'Reflection factor 
explained 12.5%. These results were consistent with those of 
Treynor et al.,^' but the items assigned to each factor were a 
little different. The item 20 (Analyze your personality to try to 
understand why you are depressed) assigned to 'Refection fac- 
tor in Treynor et al.^' is included in the items of 'Brooding' fac- 
tor in this study. Item 16 and item 7 was excluded from the 
subordinate scale because of low factor loading. 

RRS-R and two subordinate scales (Brooding, Reflection) 
showed the appropriate value of Cronbach a, good internal 
consistency. The test-retest reliability of RRS-R with an inter- 
val of one month is moderate. The internal consistency of the 
original RRS was also good, but the test-retest reliability of the 
original RRS is low. Although the test-retest reliability of RRS- 
R is not enough reliable (0.48), it is higher than the original 
RRS (0.33). 

This study suggests that RRS-R is more valid and reliable 
than the original RRS in Korean patients with depression, be- 
cause the RRS-R is free from the debate about overlap with 
BDI, showing better test-retest reliability. 

We also tested the construct validity of RRS-R by analyzing 
the correlation between RRS-R and other clinical symptoms 
such as depression, anxiety, worry. RRS-R was highly corre- 
lated with other clinical symptoms as well as with the original 
RRS. Two subordinate scales of RRS-R were also correlated 
with other symptoms. But the 'Brooding' subscale was more 
highly correlated with other symptoms than the 'Reflection 
subscale. This result is consistent with the study of Treynor et 
al.^' in that the 'Brooding' subscale was more correlated with 
the negative aspects of ruminative response. Another study 
showed that 'Brooding' was also more related to anxiety than 
other factors.^' Unlike RRS-R, the construct validity of the 
original RRS seems not to be strong, because some studies 



found that RRS had three factors, and only one of three corre- 
lated with depression.'^ RRS-R was significantly correlated 
with BDI after excluding the items of RRS that potentially 
overlap with BDI. Therefore, we find that rumination mea- 
sured by RRS-R is correlated with depression by means of 
their shared properties, as many studies suggested.^" We sug- 
gest that RRS-R is more valid and reliable measurement than 
the original RRS. 

Rumination, especially 'Brooding', was highly correlated with 
physical complaints as well as depression, anxiety and worry 
in our study. Another study reported that rumination was cor- 
related with insomnia.^'' These suggest that 'Brooding' may 
be a transdiagnostic process of many psychiatric problems. 

The total score and two subordinate score of RRS-R were 
not different. The gender difference of the original RRS was 
not apparent in our data. This is consistent with the result of 
Watkins,^' but not consistent with that of Nolen-Hoeksema et 
al.^' Another study showed that some characteristics includ- 
ing the severity of depression were not different between gen- 
ders.^*'^' So the coping and ruminative style by gender needs 
further research. 

There are some limitations in this study. Although one highly 
experienced psychiatrist diagnosed the participants with ma- 
jor depressive disorder, structured diagnostic measure was 
not used. For confirming the construct validity, confirmatory 
factor analysis is also helpful in addition to exploratory factor 
analysis. But we did only exploratory factor analysis because 
we did not have enough number of participants to perform 
both. In addition, we removed two more items out of the RRS- 
R revised by Treynor et al.^' It could reduce the consistency 
and reliability of the measurement. 

Rumination, especially 'Brooding' is one of the important 
components of depression. Nowadays more studies are need- 
ed to reveal the longitudinal effect of rumination to various 
psychopathologies. We suggest that RRS-R is a more concise 
and proper tool to measure rumination and is as reliable as the 
original RRS. We expect that more studies will be performed 
about the rumination using RRS-R. 
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